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Abstract: On-going Higgs searches in the light mass window are of vital importance for 
testing the Higgs mechanism and probing new physics beyond the standard model (SM). 
The latest ATLAS and CMS searches for the SM Higgs boson at the LHC(7TeV) found 
some intriguing excesses of events in the -yj/VV* channels (V = Z, W) around the mass- 
range of 124 — 126 GeV. We explore a possible explanation of the 77 and VV* signals 
from the light CP-odd Higgs A or CP-even Higgs h° from the general two-Higgs-doublet 
model with fourth-family fermions. We demonstrate that by including invisible decays of 
the Higgs boson A or hP to fourth-family neutrinos, the predicted 77 and VV* signals 
can explain the observed new signatures at the LHC, and will be further probed by the 
forthcoming LHC runs in 2012. 
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1. Introduction 

The LHC searches for Higgs boson(s) in the light mass window have vital importance for 
testing the Higgs mechanism [1] and probing new physics beyond the SM. The most recent 
results from the LHC (7 TeV) have constrained the light Higgs boson of the standard model 
(SM) into the mass-range (115.5 GeV, 131 GeV) by ATLAS [2] and (115 GeV, 128 GeV) 
by CMS [3], at 95% C.L. 1 In particular, the ATLAS observed an intriguing excess of events 
for a Higgs boson with mass close to m h = 126 GeV [2]. The three most sensitive channels 
in this mass range, h° -> 77, h° -> ZZ* -> £+£-£+£', and h° -> WW* -> t+vtTv, 
contribute to the excess with local significances of 2.8a, 2.1cj, and 1.4<r, respectively. 
If this would be confirmed by the upcoming LHC data in 2012, a Higgs boson of mass 
around 126 GeV does call for new physics beyond the SM due to the vacuum instability [5]. 
Furthermore, the observed 2.8a excess in the 77 channel by ATLAS is also higher than 
the expected signals of the pure SM Higgs boson (with the same mass) by a factor-2 [2], 
which again points to new physics. 

In this work, we investigate a simple SM-extension as the new physics — the generic 
two-Higgs-doublet model (2HDM) with fourth-family SM fermions (4F2HDM). It contains 
the minimal extension in the SM Higgs sector with one more doublet and in the SM 
fermion sector with one more family. With such a truly simple addition, we study distinct 
new signatures of the light CP-odd Higgs A or CP-even Higgs h at the LHC, and analyze 
the implications for the latest ATLAS and CMS Higgs searches [2] [3]. We consider the 
4F2HDM in both type-I and type-II, with CP-conserving Higgs potential. Such 2HDMs 
contain four physical Higgs states (h°, H°, A , H^) with masses {M h , M H , M A , M ± ). 

From the latest updates at the Moriond conference [4], ATLAS further confined the allowed light SM 
Higgs mass ranges into (117.5 GeV, 118.5 GeV) and (122.5 GeV, 129 GeV) at 95%C.L., while CMS gave 
the improved Higgs mass limits of (114.4 GeV, 127.5 GeV). 
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Due to the additional contributions from heavy fourth- family quarks (t 4 , 6 4 ), the gluon- 
fusion production cross sections of gg — > h°,A° at the LHC are generally much enhanced 
relative to gg — > h° in the SM, and thus may be easily excluded by the current LHC 
data. In the present study, we demonstrate that the invisible Higgs decays into the light 
fourth-family neutrinos, h°,A° — > v^v^, A/4A4, can become the major channel, and play 
a key role to properly suppress h°,A° -)■ 77 rates for the consistency with the existing 
LHC data. Especially, we show that such a light Higgs boson h° or A with mass around 
124 — 126 GeV can nicely explain the observed event excesses by ATLAS [2] and CMS [3]. 

2. Signals of CP-Odd A in 4F2HDM with Invisible Decays 

We start with the analysis of CP-odd Higgs boson A . The general 2HDM allows A to 
be the lightest Higgs boson for proper parameter space of the Higgs potential, unlike the 
minimal supersymmetric SM (MSSM) where the lightest Higgs boson is always hP. An 
explicit realization of such 2HDMs is given by the dynamical top-seesaw model [6], where 
the light mass of the composite pseudo-scalar ^4° is induced by the topcolor instanton effect 
[7] and thus can naturally serve as the lightest state in the Higgs spectrum. Since A has 
no cubic gauge couplings at tree-level, it mainly decays into the SM fermion pairs and the 
99/ll final states (via triangular fermion- loops) . So the decay channel A — > 77 could 
be important for detecting such a light ^4° boson at the LHC. However, it was recently 
found [8, 9] that a light A in the presence of fourth-family is excluded due to the enhanced 
cross section and unsuppressed decay branching ratio of ^4° — > 77 . We note that this 
exclusion holds only in certain parameter region. In the following, we will include the 
invisible decays ^4° — > z^ 4 i/ 4 , A/4A/4 for the fourth- family neutrinos being lighter than half 
of M A , and study the distinct new LHC signatures of the ^4° Higgs boson. 

The Higgs potential of the general 2HDM contains two characteristic input parameters, 
the tan/3 = v 1 /v 2 as the ratio of two Higgs vacuum expectation values (VEVs), and the 
mixing angle a from diagonalizing the mass-matrix of neutral Higgs bosons (hP, H°) . 
It was shown [10] that such 2HDM with fourth-family fermions is consistent with the 
electroweak precision constraints. Ref. [11] also found that within broad parameter regions, 
the 4F2HDM can satisfy the B — > X s ^f and B — B q mixing constraints. For the present 
study, we focus on two types of CP-conserving 2HDMs without tree-level flavor-changing 
neutral currents (FCNC) [12], the type-I and type-II 2HDMs including the fourth-family. 
By definition, the type-I 2HDM assigns the first Higgs doublet $ x (with VEV to couple 
with all fermions via Yukawa interactions and generate their masses, but the second Higgs 
doublet <I>2 (with VEV v 2 ) does not. The type-II 2HDM has & 1 couple to all up-type 
fermions and $ 2 to all down- type fermions. The most general Yukawa interactions for the 
pseudo-scalar A in the 4F2HDM can be expressed as, 

^Yukawa = " ^ ^{7^5 f A° , (2.1) 

where the couplings £ J A in the 4F2HDM-I and -II are summarized in Table 1 . 



- 3 - 





4F2HDM-I 


4F2HDM-II 


tu 


cot /3 


cot /3 


e A 


-cot/3 


tan /3 


a 


cot /3 


cot /3 


e A 


— cot /3 


tan /3 



Table 1: Yukawa couplings of the CP-odd Higgs boson ,4° in the 4F2HDM-I and 4F2HDM-II. 



The major production channel of A at the LHC is the gluon-fusion process, and its 
cross section differs from that of the SM Higgs boson (coupled to three families of SM 
fermions) through the ratio, 
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Here the form factors for the CP-even and CP-odd Higgs bosons take the forms [13], 
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M% A j (4m 2 ). Notice that the ratio of the on-shell production cross sections (2.2) 



is clearly independent of the center-of-mass energy of the LHC. This is also true for the 
ratio of the corresponding signal event numbers, as the integrated luminosity is the same for 
both cross sections. Hence our predicted ratio of signals for either production cross sections 
or number of events should also apply to the forthcoming LHC runs with higher collision 
energies and/or higher luminosities [14]. Then, we compute the ratio (2.2) for the inputs 
tan/3 = 1 and tan/3 = 5 in Fig. 1. For larger tan/3 vlaues, the ratio (2.2) for 4F2HDM-II 
receives an enhancement from fourth- family quark 6 4 ~ tan 2 /3 \T A {j h )/I s (T t )\ 2 . Thus 
the production cross section a[gg — > ^4 ]4F2H is more enhanced for large tan 2 /3 relative 
to that of the SM Higgs boson. On the other hand, all type-I Yukawa couplings are 
controlled by an overall factor cot/3 as shown in Table 1. So the fourth-family quarks 
give contributions proportional to a uniform factor ~ cot 2 /3 \X a {tq) /X s {r t )\ 2 . Obviously, 
the fourth-family corrections to the gluon-fusion cross section is enhanced by tan 2 /3 in 
4F2HDM-II while suppressed by cot 2 /3 in 4F2HDM-I for tan/3 < 1 . Fig. 1 shows that for 
tan/3 ^ 1 , the A production is always enhanced in 4F2HDM-II, and the enhancement 
factor is about O(20 — 60) for tan/3 = 1 — 5 in the mass-range M A < 300 GeV. In 
contrast, the A production in 4F2HDM-I is moderately enhanced by a factor of 0(3 — 10) 
for tan/3 = 1 and M A < 300 GeV, which is much lower than that of 4F2HDM-II with 
the same tan/3 = 1 . Due the opposite signs between the up-type and the down-type 
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Figure 1: Ratio of a[gg — > A°] 4F2H /a[gg — > h°] SM3 f° r tan/3 = 1 (solid lines) and tan/3 = 5 



(dashed lines). 

Yukawa couplings Q and £^ of 4F2HDM-I (Table 1), a cancellation appears between 
their contributions to the ratio (2.2). This cancellation becomes maximal when the two 
heavy quarks (i 4 , i> 4 ) are degenerate. So the cross sections in (2.2) are dominated by the 
third- family top-quark-loop and the inequality I A (r t ) > Z s (r t ) for a given Higgs mass 
determines the final enhancement of the ratio (2.2) for tan/3 = 1 , as shown in Fig. 1 for 
4F2HDM-I. We also see that for a larger tan/3 , such as tan/3 = 5 , the A production in 
the 4F2HDM-I is suppressed by about a factor-10 relative to that of the hP in the SM3. 

In general, the type-II Higgs sector is more nontrivial and interesting than the type-I, 
it is also well motivated for the fermion mass generations. In the natural parameter-space 
of tan/3 > 1 , it is very challenging to make the 4F2HDM-II safe from the LHC constraints 
as noted before [8] [9] . We have to sufficiently reduce the signals by suppressing the rele- 
vant decay branching fractions of ^4° . For this purpose, we propose a new resolution by 
exploring the invisible decays of A into light fourth-family neutrinos, A -> v A u A /A/4 A/4 • 

Generally, the fourth-family neutrinos (P 4 , A/" 4 ) have both Dirac and Majorana mass- 
terms which form the seesaw mass-matrix, 



After the diagonalization into mass-eigenbasis (z/ 4 , A/" 4 ) , their mass-eigenvalues are deter- 
mined by the two mass-parameters m D and M N , 




(2.5) 




(2.6) 
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with the mixing angle defined as, 



t», _J^_J2B-_. /*«-, (2.7) 

where tan 0^1 must hold due to M V4 ^ M/v" 4 • The case of tan 8 = 1 corresponds 
to M N = , leading to two degenerate states of pure Dirac neutrinos. The limit of 
tan 6 = is unphysical since it gives M UA = . The LEP precision data on invisible Z 
decays constrain M U4 > \ m z > WFlUe the naturalness requires Yukawa couplings to be of 
0(1) and thus the Dirac mass m D = 0(100 — 500)GeV. Hence, our parameter space for 
the mixing angle 9 is confined into the range of 0.1 < tan# ^ 1. The fourth-family 
neutrino v A can be stable on the collider lifetime, and the current experimental lower limits 
on stable neutral heavy lepton mass is as low as 39.5 GeV at 95%C.L., as inferred from 
the invisible Z width [16, 17]. Taking into account of the mixing between two Majorana 
neutrinos v A and A/4, this bound may be further reduced to 33.5 GeV [15]. Such light 
fourth-family neutrinos will open up new invisible decay channels for both ^4° and h . 
The lower limit on the mass of fourth-family charged lepton l A is about 100 GeV, as given 
by the LEP-II direct searches [18]. These limits show that the fourth-family neutrinos 
{y A , AQ and leptons (£ 4 ) can be much lighter than the fourth-family quarks (i 4 , 6 4 ). For 
short-lived (i 4 , 6 4 ) with prompt decays of t 4 ^-bW and b 4 —}tW, the current searches 
at the LHC(7TeV) places the following lower bounds (95%C.L.), M h > 552 GeV from 
the CMS with C = 4.71b" 1 [19] or M h > 404 GeV from the ATLAS with C = 1.04 fb" 1 
[20], and Mb 4 > 495 GeV [21]. Meanwhile, the latest analysis from the Tevatron searches 
[22] using an integrated luminosity of 12 fb" 1 for both CDF and DO places the lower 
mass limits, M ti > 358 GeV and M &4 > 372 GeV at 95%C.L. For illustration in the 
following analysis, we will uniformly take a sample input of fourth-family fermion masses, 
(M v M 6 , M t , M„ 4 ) = (600, 600, 300, 50) GeV, unless specified otherwise. 

For the present analysis, we will systematically explore the new decay channels of ^4° 
in the 4F2HDM, ^4° — > z^z^, A/4A/4, as well as ^4° — > £ 4 £ A , when ^4° is heavier than twice 
of v A (A/4) or £ A . The invisible decay widths of ^4° are computed at the tree-level, 

HA -+W A ) - W(1+t{m 20 )2 ( -2 J > 




T(A°-*M 4 ) = - ^ A ' 1-^ , (2.9) 

v ; 4vn; 2 (l+tan 2 60 2 1 

where the second channel (2.9) is open when Mx 4 < \Ma- The fourth-family fermions 
also contribute to the loop-induced decay widths for ^4° — > gg, 77, 7Z as follows, 

r(A^gg) 4Fm = |ggU £ f A l A {r Q ) \ (2.10) 
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Figure 2: Decay branching ratios of the CP-odd Higgs boson A as functions of its mass M A for 
the 4F2HDM-II. The other input parameters are fixed as, (tan/3, tan 6) = (1, 1) . 
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where and n£ denote the electric charge and color-factor for each fermion species. 

(sin0 w , cos9 w ) with 6 W being the weak 
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mixing angle. All decay widths in our analysis are computed by including the relevant 
NLO QCD corrections as in Ref. [23]. The form factor X. in (2.12) is given by 

f(r f ) ~ f(X f ) 



2(7>-A f ) 



(2.13) 



with Xj = m 2 z /(Am'j) . Since the form factors Ta{tj) and T a {tj, Aj) are positive for the 
fermionic contributions, all three decay widths in (2.10)-(2.12) are larger than T(h° — > 
99i Hi 1% ) i R the SM3. Including the new invisible decay channels of ^4° — > v^vJM^N^ 
with decay rates in (2.8)-(2.9) , it is possible to suppress all SM decay branching fractions 
for the low-mass range of A . In Fig. 2, we show the ^4° decay branching ratios in a wide 
mass-range of M A = 100 - 1000 GeV for the 4F2HDM-II. We take the sample inputs of 
(tan/3, tan#) = (1, 1) , where tan# = 1 corresponds to the case of z/ 4 being pure Dirac 
neutrino. Fig. 2 shows that the invisible decay A — > z/ 4 z^ 4 , A/4A/4 can dominate over all 
other channels for Ma < 2m t , while the tt and 



channels become dominant for 
Ma > 2m t . In particular, the diphoton channel A — > 77 can be suppressed by a factor 
of O(10 — 50) for Ma < 2m t , as compared to the diphoton branching fraction of the SM 
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Figure 3: Decay branching ratios of the CP-odd Higgs boson A with mass Ma = 126 GeV for 
the 4F2HDM-II. Plot-(a): Br[A°] as a function of the fourth- family neutrino mixing angle tan0, 
with fixed tan/3 = 1 . Plot-(b): BrL4°] as a function of tan/3 , with fixed tan 6* = 1 . 



Higgs boson in the same mass range. Combining this with the enhanced cross sections in 
Fig. 1, we see that the new invisible decays of A play a key role to bring down the ^4° 
signals for being consistent with the current LHC searches. Moreover, ^4° has vanishing 
cubic couplings with gauge bosons and thus no VV* final states will be produced. It is 
clear that the current limits on the mass-range of A will be much weaker than that of the 
conventional SM Higgs boson (mentioned at the beginning of Sec. 1). 

Motivated by the latest ATLAS data [2] , we focus on the case of a light ^4° with mass 
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M A = 126 GeV. The invisible decay mode is kinematically allowed for 39.5 GeV < M Ui < 
63 GeV, where the lower limit comes from the LEP constraints [16, 17]. For the invisible 
decay rates (2.8)-(2.9), we have included both Dirac and Majorana neutrino masses. In 
the pure Dirac-mass limit tan 9 = 1, the two fourth-family neutrinos become degenerate 
and thus their decay rates are equal, T(A° — > ^ 4 ^ 4 ) = T(A° — > A/4A/4) . 

In Fig. 3(a), we analyze the decay branching fractions of A versus the mixing angle 
tan# of the fourth-family neutrinos. It shows that the invisible decay channel always 
dominates over all other channels for the full allowed range 0.1 ^ tan# $C 1 . The branching 
ratios for all other SM decay channels are maximized around tan# ~ 0.88 , at which the 
second invisible decay channel ^4° — > A/4A/4 is kinematically forbidden. In Fig. 3(b), we 
further analyze various decay branching fractions versus tan/3 for the 4F2HDM-II. The 
invisible decay branching ratio Br [A — > ^ 4 z? 4 , A/4A/4] is maximized for small tan/3 ~ 1. 
When tan/3 gets larger, it gets reduced and no longer dominates over other channels; this 
could potentially cause too large 77 signals at the LHC for the 4F2HDM-II. Such a danger 
is absent for the 4F2HDM-I, where all the partial decay widths are suppressed by cot 2 /3 
due to r 4F2H _ I oc cot 2 (3 . Besides, in the 4F2HDM-I the production cross section of ^4° 
gets suppressed for larger tan/3 , as shown in Fig. 1. 

Now we are ready to evaluate the signal predictions of (<r x Br) for gg — > A — > 77 
in the 4F2HDM (type-I and type-II), and then derive the ratio (cr x Br) 4F2H /(cr x Br) SM3 , 
where the denominator is the corresponding signals gg — > h° — > 77 in the SM3 with the 
same input of Higgs mass as ^4° . We present our results in Fig. 4 for the LHC (7TeV). 
It shows that for the 4F2HDM-I, the predictions are always significantly below that of 
the SM3. For the 4F2HDM-II with M A = 126 GeV, we find that the 77 signals can be 
moderately larger than that of the SM3 in the parameter region, 2.4 < tan/3 < 4 with 
tan6> = 1 [Fig. 4(a)], or 0.1 < tan# < 1 with tan/3 = 3 [Fig. 4(b)]. But, larger values 
of tan/3 > 4 in Fig. 4(a) would cause too much excess of 77 signals, and are excluded by 
the current data. With the 4.9fb _1 data set, ATLAS collaboration observed 2.8<r excess 
of 77 events at the invariant-mass Af 77 = 126 GeV, while the expected SM Higgs signal 
is 1.4cr above the SM backgrounds, which is about a factor-2 smaller than what ATLAS 
observed [2] . The signal-reduction-rate due to various cuts and detection efficiencies should 
be roughly the same for both the SM Higgs boson and the CP-odd A boson. When the 
predicted ratio (a x Br) 4F2H / (a x Br) SM3 ~ 2 in the 4F2HDM-II, the A — > 77 signals can 
nicely explain the 2.8cr excess of ATLAS observation at M 77 = 126 GeV. For instance, 
this is realized at (tan/3, tan#) ~ (3.5, 1) in Fig. 4(a). 

As shown by Figs. 2-3, the invisible decays ^4° — > v^y^ A/4A/4 can dominate over all 
other channels in the relevant parameter regions. The suppression on the fermionic decay 
branching ratios (such as A — > bb, rf ) appears moderate in comparison with the SM3 
case. Nevertheless, the Higgs searches in the bb and rf decay modes [3] are made through 
the vector boson associated production and the vector boson fusion processes, respectively, 
which receive no new enhancement from the fourth- family fermions. This is consistent with 
the present observations of ATLAS [2] and CMS [3] , which found no excess from the bb and 
rf final states. Similar reasoning also holds for the detection of the CP-even Higgs boson 
via the bb and rr channels (cf. Sec. 3). Furthermore, the CMS detector showed no new 
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Figure 4: Predicted 77 signals from the CP-odd Higgs boson A at the LHC, computed as the ratio 
(er x Br) 4F2H /(a x Br) 

SM3- Plot-(a) shows this ratio versus tan/3, for tan# — 1 . Plot-(b) displays 
the same ratio as a function of tan 9, for tan/3 = 3 (red curves) and tan/3 = 1 (blue curves). 
For both type-I and type-II, we show the predictions for two different A masses: Ma — 126 GeV 
(solid curve) and Ma = 140 GeV (dashed curve) . The horizontal black solid- line indicates that the 
prediction coincides with the SM3 (with the same Higgs mass), while the black dashed-line denotes 
the signal prediction being twice of the SM3. 



signals in the VV* final states, and ATLAS analysis only indicated a smaller excess in the 
VV* events. It is very likely that the VV* channels contains only the SM backgrounds. If 
so, this is again consistent with our analysis of the ^4° Higgs boson, since the CP-odd ^4° 
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has no tree-level gauge couplings with VV and thus the A — > VV* decays are forbidden. 

Note that in each plot of Fig. 4, the two solid curves correspond to Ma = 126 GeV, 
and the two dashed curves to Ma = 140 GeV. We do not show a curve for Ma = 116 GeV 
since it almost overlaps with that of Ma = 126 GeV. So the parameter space between 
the two adjacent curves in each set (either red or blue) in Fig. 4 essentially represent that 
of the mass-range 116 < M A < 140 GeV. From Fig. 4, we see that should the present 
ATLAS excess at M 77 = 126 GeV be disconfirmed by this summer with more LHC data, 
our 4F2HDM-II can predict new Higgs signals in other M 77 values around 116 — 140 GeV, 
either above or below the SM3 Higgs rates. This will be further probed by the LHC Higgs 
searches. 

3. Signals of CP-Even h° in 4F2HDM with Invisible Decays 

In this section, we turn to the analysis of the CP-even Higgs boson h° in the 4F2HDM, 
and study the impacts of the invisible decays h° — > v^v^M^M^ on the LHC discovery. Due 
to the mixing between the two CP-even neutral states, we have the mixing angle a as a 
new input parameter. Unlike A , the CP-even Higgs boson h° also has additional decay 
channels of h° — > WW*, ZZ* at tree- level. We will present a benchmark model for the 
4F2HDM, and analyze the production and decays of h at the LHC. We further compare 
our predictions to that of the SM Higgs coupled with four families of fermions (SM4), by 
including the invisible decay channel of h° . 





4F2HDM-I 


4F2HDM-II 


tu 

e h 
c h 


cos a 1 sin j3 
cos a/ sin /3 
cos a 1 sin j3 
cos a/ sin /3 


cos a 1 sin j3 

— sin aj cos/3 
cos a 1 sin f3 

— sin aj cos/3 



Table 2: Yukawa couplings of the SM fermions to the lighter CP-even Higgs boson h for the 
4F2HDM-I and 4F2HDM-II. 

In the 4F2HDM, the analysis of production and decays of h° are more complicated 
than A , due to the additional decay channels in the WW and ZZ final states, as well 
as the mixing parameter a associated with two CP-even states (h°,H°). The Yukawa 
interactions of h° can be generally expressed as follows, 

Em ^ j _ q 

/ 

where the Yukawa couplings ^1 for the 4F2HDM-I and 4F2HDM-II are summarized in 
Table 2. The h° production via the gluon- fusion process receives new contributions from 
the fourth- family quarks (t 4 ,6 4 ), which are enhanced by the Yukawa couplings of (£4,64) 



- 11 - 




200 300 500 
Higgs Masses [GeV] 



1000 



Figure 5: Predicted ratio a[gg 



J4F2H 



h°] SM3 for the 4F2HDM-I (blue curve) and 
4F2HDM-II (red curve) with the sample input (tan/3, tana) = (1, —3). As a comparison, the ratio 
a [g9 ~^ h°] SM4: /(j[gg — > ^ ]sm3 * s shown for the SM4 (purple curve). 



relative to that of the SM top quark (£). We compute the ratio of production cross sections 
between the 4F2HDM and SM3 with the same mass of h° , 



E $z s (t q ) 

a[gg -> h\ Fm Q=t,t 4 ,b 4 



v[99 -> ^°] S M3 \T s {r t 



2 



(3.2) 



which is found to be generally larger than unity. In Fig. 5, we present the enhancement 
factors (3.2) for 4F2HDM-I (blue curve) and 4F2HDM-II (red curve) with the sample input 
(tan/3, tana) = (1, —3). The enhancement (3.2) is moderate since in (3.2) can be 
smaller than one, as compared to the SM4 with \(^\ = 1. For the SM4, we see from the 
purple curve in Fig. 5, a[gg — > h°] SM4 /a[gg — > h°] SM3 ps 9 holds in the limit of light Higgs 
mass M| <C (2Mq) 2 with the loop-contributions from the heavy quarks. 

We analyze the impact of fourth-family fermions on the Higgs boson h° decays. 
For relatively light fourth-family neutrinos and leptons, new decay channels of h° — > 
^4^4, A/" 4 A/" 4 , £ 4 £ 4 can be open, in addition to the conventional SM decay modes whose 
partial widths have rescaling factors |£j(| 2 and sin 2 (/3 — a) for the fermionic and VV* final 
states, respectively. Therefore, we shall rewrite the loop-induced decay rates in terms of 
the modified couplings for both bosonic and fermionic contributions, 

r(/>° -> 99 ), Fm = $$\ E $Za<T Q )\\ (3.3) 

Q=t,t A ,b A 
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Figure 6: Decay branching ratios of CP-even Higgs boson h° in the 4F2HDM-II for the mass-range 
M h = 100 - 1000 GeV and sample input (tan/3, tana) = (1, -3) . 



T(h° -> 77) 
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4F2H 



'■Ml 



167r 3 t> 2 I 



N[e%I s {r f ) + lsm(f3-a)l w (r w ) \ (3.4) 



f=t,t 4 ,b 4 ,i 4 



l(h -^ 1 Z ) 4F2H - 11 1 | ^ ^ -A/ (r /5 

v h / f = + t.h. p. w 



*> 7 f=t,t 4 ,b 4 ,£ 4 
H I 2 

+ sin( ( 5-a)^l K /(r w , A w ) , 



with the form factors, 



r 2 l 



2r 2 + 3r + 3(2r- 1)/(t) 



.A?(t,A) = I^A)-/^), 

A#(r, A) = % |4 ^3 - J*^ I 2 (r, A) + 



(l + 2r)^-(5 + 2r) 



'VV 



AM) 



AM) 
AM) 



I | /(r)-/(A) A[g(r)- ff (A)] 



2(A-r) ' 2(A-r) 2 

f{r) ~ /(A) 
2(r-A) ' 



{r-Xf 



(3.5) 

(3.6a) 
(3.6b) 

(3.6c) 
(3.6d) 
(3.6e) 
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Figure 7: Decay braching ratios of CP-even Higgs boson h° with mass M h = 126 GeV. Plot-(a): 
Br[/i ] versus ta.118 with tan/3 = 1. Plot-(b): Br[/i°] versus tan/3, with tan# = 1. In both plots 
tana = —3.0 is fixed. 



Vr 1 — 1 arcsin Jt . 
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(3.6f) 



The charged Higgs loops may also contribute to the (3.4) and (3.5). For our illustration, 
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Figure 8: Predicted signal ratios of (crxBr) 4F2H / (axBr) SM3 in the processes gg h° —> 77 
and gg ->• h° -)• VV* as functions of tan6>, with Higgs mass M h = 126 GcV for both 4F2HDM-I 
and 4F2HDM-II. We have take the sample inputs (tan/3, tana) = (1, —3). 

we consider the large M± limit where the contributions are negligible. Such large M± 
limit is also fairly reasonable from the flavor physics constraints, including the leptonic 
decay of mesons M — > lv, loop-induced b — > 57 transitions, and the mass difference AMg 
as measured in the B° — B° mixing [25, 26]. For lighter , the inclusion of charged Higgs 
loop will not affect our physical conclusion. In Fig. 6, we presented a sample of decay 
branching fractions for h° as a function of its mass M h in the 4F2HDM-II, by including 
the new invisible decay modes. It clearly shows that the invisible decays h° — > v^u^NaN^ 
can suppress the other decay channels in the light mass region of Mh < 2M W . For 
M h > 160 GeV, they no longer dominate because of F(h° -)• v A v 4 , NJ^ A )/T{h° VV) < 
1. From Fig. 5-6, we see that for a light h° with mass 116 GeV < Mh < 2m w , its 
production and decays in the 4F2HDM are very different from that of the SM Higgs boson 
due to the fourth-family quark contributions and the new channels of invisible decays. 

In Fig. 7(a), we present the decay branching fractions of h° as a function of tan# 
with tan/3 = 1 , while in Fig. 7(b) we display Br[/i°] as a function of tan/3 with tanO = 1 . 
We find that Br[/i°] is sensitive to tan/3 , and for tan/3 < 2 the invisible decays h° — > 
v^v^N^N^ dominate over all other SM channels in the full range of tan# . 

In Fig. 8-9, we present the predicted a x Br for the processes gg — > h° — > 77 and 
gg ->■ h° -> VV* in both 4F2HDM-I and 4F2HDM-II. In particular, we show the ratio 
(crx Br) 4F2H / (crxBr) SM3 , for the comparison to that of the SM Higgs boson, with the 
same mass M h = 126 GeV. In Fig. 8, we plot the ratios (a xBr) 4F2H / (a xBr) SM3 for the 
4F2HDM-I and 4F2HDM-II as functions of the neutrino mixing parameter tan 9 , with a 
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Figure 9: Predicted signal ratios of (erxBr) 4F2H / (erx Br) SM3 for gg — > h —> 77 and gg —> h — 
VV* as functions of tan/3, with Higgs mass M h = 126 GeV for both 4F2HDM-I and 4F2HDM-II. 
The neutrino mixing angle is taken to be tan# = 0.8 in plot-(a) and tan (9 = 1.0 in plot-(b), 
while the Higgs mixing angle tana = —3.0 in both plots. The horizontal dashed-line in each plot 
corresponds to the ratio, (a x Br) 4F2H / (ax Br) SM3 = 2 . 



sample input of (tan/3, tana) = (1, —3). The predictions of the 4F2HDM-I are generally 
suppressed in comparison with the SM3, thus they cannot be observed from the current 
LHC data. To detect h° in the 4F2HDM-I thus requires higher integrated luminosities 
at the LHC. For predictions of the 4F2HDM-II, Fig. 8 shows interesting excess of signals 
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Figure 10: Predicted signal ratios of (er x Br) SM4 / (a x Br) SM3 in the processes gg — > h —> 77 
and gg — > ft, — > V^* as functions of Higgs mass for the SM4. The fourth-family neutrino 
mass M v = 50 GeV in plot-(a) and M v = 60 GeV in plot-(b) with tan# = 1 are taken. 



above that of the SM Higgs boson for both 77 and VV* channels in the parameter range 
0.63 ^ tan# ^ 0.9 (with tan/3 = 1), where the 77 signals are significantly higher than the 
VV* signals. We note that such 4F2HDM-II model with tan/3 ~ 1 is quite generic for 
the dynamical fourth- family models [24]. Combined with the invisible decay channels, this 
can nicely explain why ATLAS experiment [2] has detected sizable excess of events in the 
77 mode but not the ZZ* and WW* final states. Fig. 9(a)-(b) depict these signal ratios 
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as functions of tan/3 for the neutrino mixing parameter tan# = 0.8 and tan# = 1.0, 
respectively. We find that the 4F2HDM-II always predicts larger signals than the SM3 in 
the 77 channel for tan/3 > 1 , while the VV* signals are mainly suppressed except for 
tan/3 < 2 (with tan6» = 0.8). 

For comparison with our above 4F2HDM studies, we also analyze the h° signals in the 
77 and VV* channels from the one-Higgs-doublet SM including fourth- family (SM4), with 
relatively light v A /N A . Ref. [27] showed ^f^/VV* signals from h° in the SM4 without in- 
cluding invisible decays, while the effect of invisible decays for the SM4 Higgs was discussed 
in [28] for the LEP searches and in [15, 29] for the LHC searches. In Fig. 10, we present 
the predicted signal ratios of (cxBr) gM4 / (ax Br) SM3 in the processes gg — > h° — > 77 
and gg — > h° — > VV* as functions of Higgs mass Mh for the SM4. For comparison, we 
assign the fourth-family neutrino mass, M = 50 GeV in Fig. 10(a) and M = 60 GeV in 

4 4 

Fig. 10(b), respectively. From these plots, we see that the 77 signals are always much more 
suppressed than the VV* signals. For the 77 final states, besides the overall suppres- 
sion from invisible decays h° — > v^vJN^N^ the fourth-family fermions further suppress 
the decay width of h° — > 77 due to the enhanced fermion-loop contributions that can- 
cel against the VT-loop in (3.4). Hence, for the Higgs detection in the SM4, the LHC 
should observe significantly larger VV* signals than the 77 signals; this is just opposite 
to the most recent ATLAS and CMS observations [2] [3] . Furthermore, Fig. 10(a) shows 
that the SM4 predictions for the light mass-range 105 < Mh < 150 GeV are generally 
lower than that of the conventional SM3 through all three decay channels of 77, 7Z and 
VV* . Hence, higher integrated luminosities at the LHC are required for its detection. 
For Fig. 10(b) with a larger fourth-neutrino mass M u = 60 GeV, this window shifts to 
120 < M h < 150-160 GeV. Fig. 10(b) shows that the SM Higgs boson with M h < 120 GeV 
or Mh > 160 GeV is clearly excluded by the current LHC data due to excessive signals in 
the VV* final states. If the recent event excesses around mass-values of 124 — 126 GeV 
at the LHC (7TeV) [2, 3] are actually due to statistical fluctuations or other systematical 
errors, then the low Higgs-mass-ranges of the SM4, namely 105 < Mh < 150 GeV in plot- 
(a) and 120 < Mh < 150 GeV in plot-(b), are still viable and will be further probed at the 
LHC with higher luminosities. 

4. Conclusions 

The on-going LHC Higgs searches for the light mass window (116 — 130 GeV) are crucial 
for testing the Higgs mechanism and probing new physics beyond the SM. In this work, 
we studied the new signatures of a light CP-odd Higgs A or CP-even Higgs h° in the 
77 and VV* channels (V = W, Z) at the LHC(7TeV), as predicted by the two-Higgs- 
doublet-model with the fourth-family fermions (4F2HDM). By including the invisible decays 
of Higgs boson A or h° into fourth- family neutrinos v^v^jM^M^, we demonstrated that 
the predicted 77 and VV* signals can explain the recently observed excesses of events 
in ATLAS [2] and CMS [3] detectors. Due to the absence of cubic gauge-couplings A°-V- 
V , the decay channel A — > 77 becomes unique for discovering ^4° in the light mass- 
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range 116 — 130 GeV. Although the fourth-family quark-loops significantly enhance the 
production cross section of the gluon-fusion process gg — > A relative to that of gg — > h 
in the conventional three- family SM (SM3) as in Fig. 1, the invisible decay modes A — > 
v A v A ,N A N A can properly suppress the A — > 77 branching fraction (Figs. 2-3) and make 
the 77 signals mildly exceed that of the SM3 (Fig. 4). Hence, we found that for our 
4F2HDM-II (with generic type-II Higgs sector), a light ^4° with mass 124 — 126 GeV can 
nicely explain the excess of 77 signals at the LHC [2, 3]. At the same time, the A Higgs 
boson gives no signal for VV* channels. Note that the latest ATLAS search showed lower 
excesses in VV* modes and the CMS analysis found no excess in the same channel. If a 
light Higgs boson indeed exists, more LHC data in 2012 will pin down the possible signals 
in both 77 and VV* channels, and thus can further discriminate the CP-odd scalar ^4° 
from the CP-even scalar hP . In contrast, the 4F2HDM-I prediction of A signals in 77 
mode is always suppressed relative to that of the hP in the SM3 throughout the parameter 
space. Hence, for the 4F2HDM-I, detecting ^4° in the 77 channel will require higher LHC 
luminosities than that of the SM3 or the 4F2HDM-II. 

We further study a light CP-even Higgs boson h° in the 4F2HDM (type-I and type-II) 
and analyze the LHC signals in the presence of invisible decays h — > u A u i ,M 4 M A . We 
demonstrated that the branching fraction of this invisible decay channel becomes dominant 
in the light h° mass-range 116 — 150 GeV, and the 77 and VV* modes are suppressed 
accordingly in comparison with the SM3 (Fig. 6-7). Since fourth- family quarks always 
enhance the production cross section of the gluon-fusion gg — > h° (Fig. 5), we found that 
for interesting parameter regions of the 4F2HDM-II, the final signals (including decay 
branching fractions) can mildly exceed the SM Higgs signals in the 77 channel, as well as 
the VV* channel with less enhancement (cf. the parameter space 0.63 < tan# < 0.9 in 
Fig. 8). This can nicely explain the excesses of events for invariant-mass 124 — 126 GeV 
as observed by ATLAS [2] and CMS [3] . We also found parameter regions with enhanced 
77 signals, but suppressed VV* events (Figs. 8-9). If the forthcoming LHC runs in 2012 
only confirm the excess of 77 signals but not the VV* events, our model does provide 
good predictions for this, as shown in Figs. 8-9. On the other hand, the 4F2HDM-I always 
predicts larger VV* signals than 77 , but they are both significantly lower than the SM3 
and thus harder to detect (Figs. 8-9). Should the present event excesses of ATLAS and 
CMS not be confirmed with more data in 2012, the 4F2HDM-I will serve as a proper 
candidate for this light Higgs mass-window. Thus, the on-going LHC Higgs searches will 
probe the distinct predictions of the 4F2HDM. 2 

Finally, as a comparison with our 4F2HDM, we also analyzed light Higgs signals for 
the one-Higgs-doublet SM with fourth-family fermions (SM4), in the presence of invisible 
decay mode h° — > v A v^ A/" 4 A/" 4 . We showed that due to the overall suppression on the 
decay branching fractions of 77 and VV* final states, their predicted signal rates are 
mostly below that of the SM3, as depicted in Fig. 10 (a)- (b) for two sample inputs of the 
fourth-neutrino mass. In addition, we found that the VV* rates are always significantly 

2 In passing, we also note that a recent study [30] generally analyzed a hidden Higgs scenario with three- 
family fermions for the LHC test, where the visible Higgs mixes with a hidden Higgs and can have induced 
invisible decays. 
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higher than the 77 signals. These are very distinct from our 4F2HDM predictions in 
Figs. 8-9, and will be further probed by the forthcoming LHC runs in 2012. 
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